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Abstract — In order to provide support for image registration, the application of template matching in image registration is 
studied. This paper sums up four types, introduces the principle of each algorithm, and compares their advantages and 
disadvantages through simulation experiments: Based on the gray information of the algorithm is simple and real-time, hut 
for complex image and low gray contrast images, cross matching results; mathematical transform based on the complex, 
large amount of calculation; mutual information does not require preprocessing, registration effect is good, is the research 
hotspot at present, but ignores the spatial relationship between pixels. 
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I. Introduction 

Image matching is one of the traditional research directions in image processing. In practical application, It is often required 
by different sensors at different time, register the images of the same scene in the space position under different imaging 
conditions, or find the corresponding target in another picture according to the known template. Therefore, image matching 
[1-2] is the basis of image processing techniques such as image rectification and image fusion. In recent years, image 
registration [3-5] research has sprung up, especially in medical image [6-9] research. From the theoretical and conceptual 
point of view, it is the development of image matching technology, and some of the methods and ideas in image matching 
still play a special role. From this point of view, this paper sorts out the related research of image registration from the 
perspective of template matching, and analyzes their respective characteristics in combination with simulation. 

II. Methodology 

2.1 The method based on image gray information 
2.1.1. MAD algorithm and its derivative algorithm 

LeeSe proposed the Mean absolute difference algorithm in 1971, and its mathematical model is: 

1 M N 

D{i, j )=EEI s(i + s-i,j + t- 1)- ro, 0| (1) 

where: l<i <m — M + 1, l< j < n — N + 1 

S (x, y) is the detection image, and T (x, y) is the template. The algorithm calculates the average of LI distance between the 
subgraph and the template, and the sub-graph with the lowest average absolute difference is the best matching object. In 
graph S, select the MxN size of the subgraph, at a certain point (i, j) for the upper left corner,. And calculate its similarity 
with the template and traverse the entire search map. The subgraph which is most similar with the template is the final result 
of the match, in all the sub-graphs which can be found. 

The mean absolute difference algorithm [10-11] is a simple and stable algorithm with high matching degree. Different 
algorithms are derived along this line of thought. Sum of Absolute Differences algorithm is referred to SAD algorithm, and 
MAD algorithm is basically similar to the idea. But it is only simplified, which calculates the distance between the subgraph 
and the template. 

M N 

D(i, j) = YZ\s(i + s-l,j + t- 1 )-T(s, t) ( 2 ) 

5=1 t =1 

The Sum of Squared Differences algorithm (SSD), is also known as the error square sum algorithm, which calculates the L2 
distance between the subgraph and the template. 
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5=1 t =1 


(3) 


The Mean Square Difference algorithm(MSD), is known as the mean square error algorithm, which calculates the average of 
the distance between the subgraph and the template. 


1 M N 

D (*■ j )= — E E W' +* - : t j + 1 - 1 ) ■- T (s, t )] 2 


(4) 


2.2 NCC algorithm 

Normalized Cross Correlation algorithm is mainly through the normalized formula to calculate the local part of the image 
and the gray value of the template. The following correlation measure to calculate the relationship of match between the two. 
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denote the gray scale mean of subgraph and template graphs respectively in (i, j). 


(5) 


2.3 SSDA algorithm 

Sequential Similarity Detection Algorithm is put forward by Barnea and Sliverman in 1972. The algorithm is mainly through 
the error to determine the pros and cons, to find the best match. The specific process is as follows: 

Define the absolute error, which actually describes the pixel value of a certain pixel value minus the pixel mean value of the 
image, and The absolute value of sub-map minus template map corresponding to the location of the pixel poin: 


e(i,j,s,t) = \s, :j (s,t)-S -T(s,t) + T 
1 < / < m - M - 1,1 < j < n - N -1 


Where, the ones with the crossed lines represent the mean of the subgraph and template respectively: 


_ / \ 1 M N 

5,., =^(5,. ,.)=-VVy ( s ,t) 

_ i M N 

t=e(t)= - YYr(s,t) 

v ' Mxivtrtr vw 


(7) 

( 8 ) 


In the template map, randomly selecte non-repetitive pixels, and calculate the absolute error with the current subgraph. With 
the error accumulation, write down the cumulative number of times H, when the error accumulated value exceeds the 

threshold. The cumulative times of all subgraphs H is represented by a table R (I, j). SSDA detection is defined as: 


R{i,j) = (H 


min 

\<H <M xN 


H 

E^ e(i,j,s,t)>Th 


\_h=l 


(9) 


The threshold of the valve is the interruption condition of the program. It is also a measure, which increases slowly by 
comparing the cumulative growth rate of the error, which is likely to be the matching point. 

2.4 PIU algorithm 

In 1992, Woods found that in the medical image, the same tissue structure was different in different modes of gray values, 
thus suggesting an image registration based on the uniform intensity of MR PET. The basic idea of PIU measurement is that 
the pixel of a certain grayscale value in a mode is the distribution of a different grayscale value in the other mode. The 
expression of PIU measure is defined as: 
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Nfi r ,(r) rN Pl (f) 


( 10 ) 


( 11 ) 


Among them, N is the total number of pixels in the template, which is the product of the number of template rows. Tl r and 
flf respectively represent the number of pixels in the template and the subgraph with the grayscale of r and / , and it 

should be noted that although the gray values of the two are different, there is a certain corresponding relationship. F f 
represents a subgraph in the search diagram. Where: 

11 

,l r co r 

/<»(/)=— 

n f °>f 
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°R ( r ) = — Z “ Ftf (/ )f 

U f ®/ 

A.E-CXff) indicates that the gray value of r pixels in template R is the sum of pixel gray values in the corresponding 

CO r 

position in subgraph F z . 

III. The method of mathematical transformation 
3.1 Fourier-Mellin invariant 

Reddy et al. proposed the Fourier-Mellin invariant based on the translational property of Fourier transform. 

Given two images f x (x, j) and f 2 {x, y), the following geometric transformations are met: 

/ 2 (x,y)=/ 1 (a(xcos6» 0 + ysm9 0 )-dx,a(-xsm9 0 + ycos6 0 )-dy) 

Where dx and dy are the translations, CC 3 represents the scale factor for the two image sizes, and 0 0 is the rotation 
angle. The Fourier transform can be used to obtain their relationship in the frequency domain: 


F 2 {x,y) = a 2 | F^a l {jucos,d 0 + vsmO Q \a Jvcos#,,-//sin# o )jexp{-y0 /2 (//,v)} 


(13) 


Where, ^ 2 (//, v) is the spectral phase of image f 2 (x, y ) , and the shift property of Fourier transform can have its power 
spectrum relation as: 

IF 2 (//, 1 /)| = cT 2 1Fj [a -1 (//cos6> 0 + vsin^ 0 ),ct“ 1 (t/cos6 > 0 -//sin6> 0 )j (14) 

Let's rewrite this in terms of polar coordinates: 

|a _1 (-//cos^ 0 +vsin<9 0 ) = — cos(d-0 0 ) 


a 

< 2 _1 (-//sin^ 0 + vcos# 0 ) = —sin(#-# 0 ) 

a 


(15) 
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[s(p,6) = \F 2 (p cos 0,p sin 0^ 
[R(p, 0) = ^{pcosO, psmO^ 

Thus, the above power spectrum relation can be rewritten as 



pi = log p 

The logarithm < is introduced to further rewrite. 

[k = loga 

S(p, 0 ) = a 2 R(0 -0 O ,A -k) 


(16) 


(17) 


(18) 


By Fourier transform: 

S(p,v) -a ~ 2 R{p,v) exp{- j2/r(p8 0 + vk )} (19) 

Si^p, v) and R(p, v) are pairs of matching images pairs, and the upper formula transforms the rotation and scaling of the 
two into the translational change of the Fourier domain. 

3.2 SATD algorithm 

The Sum of Absolute transformation Difference (SATD algorithm) is a summation algorithm of the Absolute value of adama 
transformation. The Hadamard transform, or the walshe-adama transformation, is a generalized Fourier transform, which is 
an orthogonal square matrix composed of the +1 and -1 elements. The so-called orthogonal square matrix means that any two 
rows (or two columns) of it are orthogonal. The hadamard transform is equivalent to multiplying the original image S matrix 
by one hadamard transformation matrix, H, which is HQH. The sum of the absolute value of the elements obtained after 
transformation is the value of SATD, which is the basis for the discrimination of similarity. Go through all of the subgraphs 
above and find the smallest subgraph of the SATD value, which is the best match. 

3. Methods based on mutual information 


The registration of mutual information is a hot topic in the field of medical image registration in recent years. In 1995, 
collignon and viola were first used for medical image registration. Mutual Information (MI) describes the correlation 
between the two systems. In the registration of two images, the mutual information is to reflect the degree of mutual 
information between them through their entropy and combined entropy. For an image, its entropy represents the information 
contained in the image. Its mathematical form is as follows: 



i =L 


H ( R )= “X Pi l °SPi 


( 20 ) 


p t represents the probability of grey degree i . h represents the total number of pixels of i pixels in image R , and 

N represents the grayscale series of image R .The combined entropy reflects the correlation between the two images, R 
and S . The joint information entropy of R and S is expressed as: 

H(R,S) = -Y J Pjr,s)\ogPjr,s) (21) 


( 22 ) 


For images R and S , the mutual information is expressed as: 

m(r, s)=h(r ) +h(s)-h(r,s) 
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According to the definition of MI, when the similarity of two images is higher or the greater the overlap, the mutual 
information between them is larger, but the overlap part of the meeting causes misregistration. Subsequent researchers point 
out that the reduction of overlapped areas means less sampling points, thereby reducing the statistical index of probability 
distributions; At the same time, with MI as the correlation measure, the overlap between the two images decreases, which 
can lead to misregistration. Mismatch usually occurs when the gray value gap between image and background is smaller, 
while the increase in marginal entropy is much faster than that of combined entropy. To this end, Studholme et al introduced 
the concept of NMI (normalized Mutual Information). Maes et al. introduced the concept of ECC (Entropy Correlation 
Coefficient,). The formula is as follows 


nmi(r,s) 


h(r)+h(s) 

h(r,s) 


ecc(r,s) 


2 Ml(R,S) 

h(r)+h(s) 


(23) 


The greater the similarity between the two images, the greater the correlation and the smaller the joint entropy, the greater the 
mutual information. 


IV. Experimental Results 

Several representative algorithms are selected from the three methods. For the Fourier-Mellin method, it was tested in four 
cases, such as rotary translation, and found that its registration effect was good. 



Template SAD search figure SAD registration 

Fig. 1. SAD REGISTRATION 



Template (crop) Template (rotation) Template ((rotation +translation) Template (translation) 
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Fourier-Mellin search figure 


Fourier-Mellin registration figure 


Fig. 3. Fourier-Mellin registration results 


Template MI registration figure NMI registration figure ECC registration figure 

FIG. 4. MUTUAL INFORMATION REGISTRATION RESULTS 

V. Conclusion 

The results show that the algorithm based on gray-level information is simple and real-time, and it is sensitive to noise. The 
calculated amount is proportional to the size of the input image. For the image with complex image and low gray contrast, 
the matching result is cross- The Fourier-Mellin method is still correct for the picture after the rotation translation. The 
mutual information does not need to be preprocessed and the registration effect is good. It is the current research hotspot, but 
ignores the spatial position between the pixels relationship. 
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